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ABSTRACT 



This study explores the efficacy of two methods of 
teaching students, modeling and concept formation, to express 
warranted uncertainty in classroom discussions and in written work. 
The subjects were fifth graders from a lower middle class background 
who were divided into four groups: (1) a control group, (2) a group 

that observed a model express warranted uncertainty and receive 
reinforcement, (3) a group receiving concept training, and (4) a 
group receiving both modeling and concept training treatment. Concept 
training proved effective in teaching students to discriminate 
between kinds of problematic situations on pencil and paper tests, 
and modeling proved effective in teaching expression of warranted 
uncertainty in group discussions. The treatments used herein are 
readily usable in the classroom by teachers. (Author) 
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Introductory Statement 



The central mission of the Stanford Center for Research and Develop- 
ment in Teaching is to contribute to the improvement of teaching in 
American schools. Given the urgency of the times, technological develop- 
ments, and advances in knowledge from the behavioral sciences about teach- 
ing and learning, the Center works on the assumption that a fundamental 
reformulation of the future role of the teacher will take place. The 
Center’s mission is to specify as clearly, and on as empirical a basis as 
possible, the direction of the reformulation, to help shape it, to fashion 
and validate programs for training and retraining teachers in accordance 
with it, and to develop and test materials and procedures for use in these 
new training programs. 

The Center is at work in three interrelated problem areas: 

(a) Heuristic Teaching , which aims at promoting self-motivated and sus- 
tained inquiry in students, emphasizes affective as well as cognitive 
processes, and places a high premium upon the uniqueness of each pupil, 
teacher, and learning situation; (b) The Environment for Teaching , which 
aims at making schools more flexible so that pupils, teachers, and learn- 
ing materials can be brought together in ways that take account of their 
many differences; and (c) Teaching the Disadvantaged , which aims to deter- 
mine whether more heuristically oriented teachers and more open kinds of 
schools can and should be developed to improve the education of those 
currently labeled as the poor and the disadvantaged. 

The study reported in Research and Development Memorandum No. 64 
was carried out by the Uncertainty Studies project. Two methods of 
teaching children to recognize when statements or situations require 
further exploration and when they may be regarded as factual were tested. 
How to teach children to make this distinction and thus develop their 
ability to think reflectively contributes directly to the aims of the 
Heuristic Teaching program, of which the project is a part. 



Abstract 



It has been observed that elementary school children tend not to identify 
problematic situations or to indicate uncertainty about such situations. To 
test two methods of teaching fifth-grade children to acknowledge warranted un- 
certainty, 32 boys and girls were divided into four groups. Group I received 
no training; Group II (concept learning) was taught to give examples of various 
types of problematic situations; Group III (observers of rewarded -model) observed 
a well-liked student express warranted uncertainty about problematic issues in a 
class discussion, and receive praise for this behavior; Group IV received both of 
the above treatments. In subsequent group discussions, students in Groups III and 
IV more frequently expressed warranted uncertainty than students in Groups I and II. 

On a written test, students in Groups II and IV (concept learners) indicated un- 
certainty more frequently in group discussions, and were better able to discrim- 
inate between problematic and nonproblematic statements than subjects in Groups I 
or III. A delayed post test indicated that the skills learned in Groups il and IV 

were fully retained three weeks later. 

Results -indicate that concept learning is required for accurate discrimin- 
ation of problematic statements, but that norm learning is required for public ex- 
pression of warranted uncertainty; there was no significant transfer of norm learn- 
ing to written performance, or of concept learning to group behavior. The data also 
show that children who are not trained to express warranted uncertainty tend to 
regard statements that seem not necessarily true as false, rather than as problematic. 

vii 
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TEACHING CHILDREN TO INDICATE UNCERTAINTY 



AND TO DISCRIMINATE BETWEEN PROBLEMATIC 
AND NONPROBLEMATIC STATE14ENTS 



Joan E, Sieber, Marilyn Epstein, and Charles Petty 



When a child is involved in a situation that is only partially familiar to 
him, will he respond if shown or asked about some aspect of the situation that 
he cannot explain? Studies indicate that middle-class children and adults whose 
uncertainty is aroused in this way spend more time inspecting the situation 
(Rothkopf & Bisbicos, 1967; Rothkopf, 1968), ask more questions (Berlyne & From- 
mer, 1966), learn more (Berlyne, 1954, 1966; Rothkopf, 1968; Paradowski, 1967), 
remember more (Berlyne & Frommer, 1966), indicate that they wish to know more 
(Berlyne, 1954), and develop more higher-order concepts (Smedslund, 1961; Bruner, 
1967) about the situation than similar individuals who are exposed to a compar- 
able situation but whose uncertainty is not aroused- Uncertainty, as the word is 
used here, refers to the state of having either no response or various plausible 
responses to a situation that one wishes to understand. Uncertainty about some 
matter does not mean total ignorance or evasion of it. 

What happens to a person when he becomes uncertain, and why may uncertain- 
ty lead to inquiry, learning, and productive thinking? Uncertainty leads to a 
state of psychological and physiological disturbance. The uncertain individual 
feels in conflict about what he is to believe or do. Also, there is usually an 
increase in his heart rate (Lacey, J. I., Kagan, Lacey, B, C. , & Moss, 1963), 
level of perspiration, and muscle tension (Berlyne, 1960). These and other 
physiological changes are believed to produce increased vigilance and perceptive- 
ness. Berlyne. has postulated that persons naturally seek to reduce such psycho- 
logical and physiological disturbances by reducing their uncertainty. He argues 



^Joan E. Sieber is Assistant Professor of Education, Stanford University, 
and Research and Development Associate at the Stanford Center for Research and 
Development in Teaching; Marilyn Epstein and Charles Petty are Stanford Under- 
graduate students. 
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that since the concomitants of uncertainty facilitate infrrmation acquisition, 
persons who are given an opportunity to develop their innate exploratory^ 
tendencies may learn to reduce uncertainty by acquiring and processing rel- 
evant new information. There are, of course, other ways of reducing uncertain- 
ty and its accompanying disturbances. These include ignoring the problem, 
rationalizing one of its hypothetical solutions on insufficient grounds 
(Calloway & Dembo, 1958; Jones, 1959; Berlyne, I960; Sieber, 1969), or fail- 
ing to recognize that a relevant problem exists at all (Sieber, 1964). Ob- 
viously, less productive thinking occurs if these latter ways of reducing 
uncertainty are used. . - J 

Most persons would probably agree that it is gooa pedagogy to create 
warranted uncertainty in students and then to help them obtain and organize 
the information they need in order to gain understanding. However^ it is 
well-known that few teachers provide such experience. For example, Bel.Tack, 
Kliebard, Hyman, and Smith (1966) observed that there is little questioning 
or expression of uncertainty by pupils or teachers in the classroom. The most 
common interaction pattern was one in which teachers asked questions to which 
students gave simple, factual answers. Teachers asked 80% of all the questions, 
and of all teachers’ questions only 19% required students to give an explanation. 
Sixty-five percent of all student responses were in the form of simple answers. 

Now, since teachers rarely try to arouse uncertainty, it becomes especially 
important to inquire what students do when they encounter problematic situations. 

One may readily observe that students are frequently involved in social and ac- 
ademic matters that are problematic (e.g., how to deal with an injustice among 
students, or how to determine the difference between living and nonliving things). 

In such situations, do they naturally experience uncertainty and engage in in- 
quiry without assistance from the teacher? According to Bellack et al. (1966), 
students show little spontaneous verbal indication of uncertainty. Ziller and Long, 
(1965)adminis tered to 327 children in grades two to seven a scale containing 30 
statements, none of which were known to be true or false, e.g., "There is life on 
the planets." For each item, the children were instructed to respond by circling 
"yes," "nc^" or "don’t know." Most of the children answered at least 65% of the 




3 



items "yes,' or "no," rather than "don’t know." Sieber (1969) observed that, 
when qi’*stioned orcily about problematic matters, sixth graders offered many 
answers, but in no case indicated that they did not know. These data indicate 
that unassisted students usually do not recognize problematic situations as 
such. 

This raises two related questions. Why do students respond with cer- 
tainty when it is inappropriate to do o? And, how can they be taught to iden- 
tify and investigate the problematic situations they encounter? There is, as yot, 
little understanding of the cognitive processes involved in discriminating be- 
tween problematic and nonproblematic situations. However, without being too 
specific about the nature of such processes, one may still ask why students 
fail to engage in them. One plausible explanation is that students fail to 
express warranted uncertainty because they have inadequate concepts of certain- 
ty and uncertainty. Given the infrequency of classroom discussions about prob- 
lematic matters, students may have little opportunity to identify exemplars of 
problematic and nonproblematic statements. If this is the case, then expres- 
sions of uncertainty and correct discrimination between nonproblematic and 
problematic statements should increase if concepts of certainty and uncertainty 

are learned. 

An alternative explanation is that concepts of uncertainty are rather 
well understood by students but that warranted uncertainty is rarely expressed 
in the classroom because it is socially unrewarding to do so. If this is the 
case, then expression of uncertainty and discrimination between nonproblematic 
and problematic situations should increase if students observe that such responses 
are socially rewarded. Another explanation is that both social motivation to ex- 
press uncertainty and clear concepts of certainty and uncertainty are lacking in 
most students, Hence, relevant concept learning and social reward for expression 
of warranted uncertainty are complementary forms of training having additive effects 
in facilitating the expression of uncertainty and improving discrimination between 

problematic and nonproblematic situations. 

The purpose of the present study was to evaluate the relative effectiveness 

of modeling and concept-learning procedures as means of teaching fifth-grade stu- 
dents to discriminate between nonproblematic and five types of problematic questions 
and to express uncertainty in a group discussion. Four conditions were designated. 
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of which three were experimental. In Condition I, the control condition, subjects 
received no training. In Condition II, subjects were taught to give exemplars of 
each type of problematic question. In Condition III, subjects observed a well- 
liked student who ''modeled'' correct identification of problematic questions and 
was socially reinforced for this by the experimenter. In Condition IV, subjects 
received both of the above treatments. 

It was predicted that subjects in Conditions II, III, and IV would (a) 
more readily indicate uncertainty in a group discussion, and (b) more frequently 
express uncertainty and correctly discriminate between problematic and nonproblem- 
atic statements on a i^ritten test than control subjects. Further, it was hypoth- 
esized that concept learning (Condition II) would facilitate written performance 
more than modeling (Condition III) , that modeling would facilitate expression of 
uncertainty in a group discussion more than concept learning, and that students 
in Condition IV would perform better in both a group discussion and a written 
test than subjects in Conditions I, II, and III. 

Method 

Subj ects 

Subjects v/ere 16 boys and 16 girls from the middle- to lower-middle class 
socioeconomic range who attended fifth grade at a public elementary school in the 
Bay Area of California. Their mean IQ, as measured by the California Test of Men- 
tal Maturity (CTMM) was 103.0, and the standard deviation was 12.7. These pupils 
were assigned to a control group and three experimental groups as follows. All 
students from two fifth-grade classrooms .^ere divided according to sex. Students 
of each sex were then ranked according to IQ. One of the four highest-scoring 
boys and one of the four highest-scoring girls were then randomly assigned 
to each of the four groups, followe.d'.by the next four of each sex, etc., until 
there were four boys and four girls assigned to each of the four groups. 

Procedure 

The experimenters were introduced to the students by their teachers. It was 
explained that the experimenters were Stanford students who would serve temporarily 
as teacher aides and would teach some interesting new things. The experimenters 
spent two afternoons in the classrooms completing scheduling arrangements with the 
teachers and becoming acquainted with the students. 
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The main aim of Condition II was to teach students to discriminate be- 
tween the following six kinds of questions, the first of which is nonproblematic, 
and the rest of which are problematic: 

(1) Questions that are not problematic to the person to whom they are addressed. 

E.g. : What is your name? What is the name of your school? Who is your 

best friend? 

(2) Questions concerning things the respondent doesn’t know, but someone else 

does. E.g* : How old am I? How tall is the school flagpole? Who lives 

two blocks from here in the third house from the corner? 

(3) Questions concerning things no one knows, but for which there presently 
exist ways that one could discover the answer. E. g.; How many leaves are 
on that tree? How many words are in today’s paper? What kind of birds are 
nesting in this tree? 

(4) Questions concerning things no one knows, and no one knows how to discover 
at this time. E. g.: What is a sure cure for a common cold? How many stars 
are there in the sky? How many kinds of living things are there on the 
South Pole? 

(5) Question requiring answers that are value judgments and are therefore not 

necessarily true for all persons. E. g.: Wliat is the best-tasting food in 

the world? Is summer or winter the nicest time of the year? What kind of 
person should one choose as a friend? 

(6) Questions concerning events that have not yet occurred, thus requiring 
answers that no one can presently give with total accuracy. E. g; 

\^en will the first man land on Saturn? What will we be doing this time 
next year? How tall will you be when you are fully grown? 

Subjects in Condition II were taken individually by the experimenter to 
a pleasant place on the playground. After establishing rapport, the experimenter 
said, "We want to teach you and the rest of the class how to tell the difference 
between types of questions you can answer correctly and types of questions to 
which you can’t be sure of the answer. There are a lot of things no one knows 
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very much about. Also, some people know some things other people don’t know. 

Can you ask me a question that you can answer but I can’t?" Whether or not 
the subject answered satisfactorily, the experimenter asked him two questions 
which the experimenter could answer but the subject could not. The subject was 
then requested to ask a question he could answer but the experimenter could not. 
The subject was coached until he could ask at least one such question. 

He was then told, "There are other kinds of questions to which no one knows 
the answer but we could figure out a way to find the answer." Since this and the 
subsequent questions were more difficult than the initial one, the experimenter 
first gave an example of one such question before asking the subject if he could 
generate another like it. Whether or not the subject answered satisfactorily, 
the experimenter asked two more questions of the same kind and explained how they 
were the same. The subject was then asked to give another example of the same 
kinds of question and was coached until he could give at least one. Identical 
procedures were used to teach each of the rest of the concepts. 

Although the experimenters generally followed the above procedure, the 
details of each training session varied somewhat according to the ability and 
interest of the subject. The training criterion was reached when each subject 
was able to give at least one example of each of the five kinds of problematic 
questions. The training protocol in Appendix A exemplifies a typical session. 

For Condition III, a bright, well-liked girl was chosen to be the model. 
She was trained as in Condition II and was also trained to give the appropriate 
answers to 18 questions about a short film. The questions about the film in- 
cluded three of each of the six kinds of questions used in Condition II. The 
film was about a restaurant; some examples of the questions were; "What is the 
vjaiter going to do?" "How many square feet of cloth are there in that table- 
cloth?" Subjects in Condition III and the model were then shown the film as a 
group. During the viewing, the film was stopped at various points and the ex- 
perimenter asked the 18 questions. 

For each question, three subjects were called on to answer according to 
a random order that was previously determined by assigning the students’ alpha- 
betically ordered names to sequential, randomly ordered numbers. If one or more 
of the three respondents answered the question with some appropriate indication 




uncertainty, the next question was raised. Otherwise, the model was called on 
and reinforced for the appropriate response. The experimenter reinforced all 
instances of appropriate uncertainty but was not critical of other kinds of re- 
sponses. This procedure continued until all 18 questions had been answered. 

In Condition IV, subjects first received individual training identical 
to that given in Condition II. They then received group training identical to 
that given in Condition III. 

Subjects in Condition I, the control group, were chatted with individually 
by the experimenters and were shown the same movie that was shown in Condition III. 

They received no specific training, however. 

About two hours after the training had been administered, subjects were 
again divided into their four groups. Each group was shown a film different from 
the one shown during the training of Conditions III amd IV. A group discussion of 

the film was held with subjects in each condition, in the course of which they 

« 

were asked 15 questions concerning the film. The questions included three of 
each of the five kinds of problematic questions listed above. Three subjects 
were called on (again in a predetermined random order) to respond to each question. 

The experimenter was equally cordial and encouraging to each respondent. Responses 
were recorded and later tabulated according to whether uncertainty had been ex- 
pressed. 

On the following day, subjects from all four conditions were gathered into 
one group. They were told they would sc. a film about an Egyptian boy ana his 
camel and would then be asked to answer a questionnaire about the film. The 
questionnaire was handed out(for a copy, see Appendix B) , preceded by directions 
including examples and explanations of the kinds of problematic and nonproblematic 
statements that appear on the questionnaire. lUese directions and explanations 
were carefully reviewed with the group. Students were then u-^ed to read the 
questionnaire before viewing the film. There were 21 ques ons, three each of the 
five kinds of problematic statements, three false, and three true statements. 

To test retention of whatever learning had resulted from the training, delayed 
posttests were planned. Due to conflicts with the school’s schedule, a delayed post- 
test of group discussion behavior was not possible. However, three weeks after 
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the first written posttest, a different film was shown to all subjects and a 
similar written questionnaire about that film was administered. 

From each questionnaire the following data were obtained: (a) the 

number of "don't know" responses given, (b) the number of "don’t know" re- 
sponses that were correct, i.e., that were given to a problematic question 
and were accompanied by a correct reason for not knowing, and (c) the number 
of problematic statements that were answered "true" or "false." 

Results 

Tendency to indicate uncertainty in the posttraining group discussion 
varied with training, as predicted, but not all of the predicted differences 
were significant. As shown in Table 1, subjects who had observed a model re- 
ceive praise for expressing warranted uncertainty in a group discussion ex- 
pressed uncertainty more frequently in a subsequent group discussion than control 
subjects who had not observed the model (TL^ “ 13.27, df = 1, p<.001. Sub- 
jects who had received only individual concept training expressed uncertainty in 
the subsequent discussion insignificantly more often than control subjects; 
moreover, they expressed uncertainty significantly less often than subjects who 
had observed a model (1^^ =4.44, df = 1, p< .05). Subjects in Condition IV, who 
had both received concept training and observed a model, performed about the 
same as subjects who had only observed a model. 

TABLE 1 

Number of Responses in Which Uncertainty 
Was Expressed in Group Discussions 











Condition 


Number of Responses in Which 
Uncertainty Was Expressed 


I 


Control 


10^ 

lit 

27^ 


II 


Concept training 


III 


Modeling 


IV 


Concept training 
and modeling 


29^ 



Note: Cells with common superscripts are not significantly different at the 

.05 level. 
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Regarding the three measures of performance on the first written post- 
test, as predicted, on all three measures the most learning was evinced by 
subjects in Condition IV. Conditions II, III and I followed in that order. 

The Kruskal-Wallis one-way analysis of variance indicated that not all of 
these differences were significant, however. As Table 2 indicates, signif- 
icantly fewer "don't know" responses were given by subjects in Condition I 
than by subjects in Condition II {it} = 3.86, df = 1, p<.05) or Condition 
IV (%2 = 4.27, df = 1, p< .05) but Conditions I and III did not differ sig- 
nificantly. With regard to the correctness of "don’t know" responses, control 
subjects were significantly less often correct than subjects who. had received 

concept training (for Condition I, = 3.94, df = 1, p<.05; for Condition III, 
2 

"Tl = 4.28, df = 1, p<.05), but did not differ significantly from subjects in 
Condition II. Finally, subjects who had received concept training gave signif- 
icantly fewer "true" or "false" responses to problematic statements than control 

2 

subjects, (comparing Condition I and II, 7b = 4.46, df = 1, p<.05, and com- 
paring Condition i and IV, 7b ^ = 8.52, df = 1, p<.01). 

As indicated in Table 3, the observed differences between groups on the 
delayed written posttest paralleled almost exactly the differences that were 
observed in the first written posttest: control subjects gave fewer "don't 

know" responses than subjects in Condition II (/b = 6.17, df = 1, p<.02) or 
Condition IV = 7.24, df = 1, p-<.01, but did not give significantly fewer 

"don’t know" responses than subjects in Condition III. However, only subjects 
in Condition II gave significantly more correct "don’t know" responses than 
control subjects (^ = 6.17, df = 1, p<.02). Finally, the number of problem- 
atic statements answered "true" and "false" by control subjects was significantly 
greater than the number of such responses gi/en by subjects in Condition II 
(71^ = 5.31, df = 1, p<.05) of Condition IV {K? = 7.73, df = 1, p<.01), but 
did not differ significantly from the number of such responses given by subjects 
in Condition III. 
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Discussion 



The results generally support the thesis that the expression of un- 
certainty by school children is influenced by both (a) belief that expres- 
sion of uncertainty will be socially rewarded and (b) understanding of concepts 
of certainty and uncertainty. Subjects who had observed a model receiving 
praise for public expression of uncertainty expressed uncertainty during group 
discussion more frequently than control subjects who had not observed such a 
model. And, subjects who had been taught to discriminate between nonproblemati 
and five types of problematic statements more correctly discriminated between 
such statements and more frequently expressed uncertainty on a written test 
than subjects who had not learned these discriminations. 

What was surprising, however, was that there was no significant degree 
of transfer from social-norm learning (Condition III) to performance on the 
written test, or from concept learning (Condition II) to performance in group 
discussions. These data imply that correct understanding or problematic mat- 
ters does not necessarily predispose one to express uncertainty in group dis- 
cussions. Likewise, knowledge that the expression of uncertainty is socially 
rewarded may Increase neither the frequency nor the accuracy with which uncer- 
tainty is expressed privately in writing. Since the teaching of the norm of 
expressing uncertainty (Condition III) and the method of teaching concepts of 
certainty and uncertainty (Condition II) are not mutually exclusive (e.g., mod- 
eling included some discussion of concepts of uncertainty, and concept training 
involved some reinforcement for expression of uncertainty), it would not have 
been surprising if Condition III training (modeling) had improved written per- 
formance and Condition II training (concept learning) had increased expression 
of uncertainty in group discussions. 

We can only speculate as to why transfer did not occur. One conjecture 
is that the skills required for successful transfer were not learned. In the 
case of Condition III subjects, perhaps all that was learned was that it is de- 
sirable to express uncertainty when at all in doubt in group discussions. They 
probably did not learn to make the distinctions that were explicitly taught in 
Condition II. Unfortunately, data are not available on the extent to which 
subjects trained in Condition II learned to discriminate between types of prob- 
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le matic issues in group discussions; students’ responses in the group dis- 
cussions were too incomplete to be coded reliably according to the categories 
used by the model or in the written posttests. In the case of Condition II, 
subjects’ transfer of the newly learned concept to the group discussion may 
have failed to occur because these subjects felt too unsure of their new 
knowledge to risk applying it before their peers. Indeed, Condition II sub- 
jects had good reason to doubt their new ability; they attained only 71% and 
77% accuracy on the two respective posttests. However, whether transfer would 
have occurred if training had been more thorough remains an empirical question. 

It has been conjectured, thus far, that subjects in Condition II learned, 
albeit imperfectly, some concepts about types of problematic statements and that 
subjects in Condition III learned to indicate uncertainty in group discussions 
when in doubt. An interesting question that remains is, how did they formerly 
regard problematic and nonproblematic statements? 

To pursue this viuestion, the data from Conditions I, II, and III were 
cast into confusion matrices which are shown in Table IV. Albiough data are 
too thin to permit elaborate analyses, some things are readily apparent: (a) 

Subjects in all three groups quite accurately identified true and false state- 
ments. (b) Control subjects (Group I) tended to consider untrue statements as 
false. A 7^ test comparing the number of correct and incorrect "false" re- 
sponses by subjects in the control and concept training conditions indicated 
that groups differed significantly in this respect (7\; = 8.34, df = 1, p = <.01). 

(c) Trained subjects, especially Condition II subjects, were generally more will- 
ing to indicate uncertainty, and more accurate in doing so. 

Untrained subjects seem to tend strongly to consider apparently true state- 
ments as true, and any other statements as false, while subjects who have been 
trained to categorize some statements as problematic are likely to test state- 
ments that are not obviously true against this third category. 

It may be concluded that, given the norms and training that prevail in 
most classrooms, specific training is required to enable students to develop 
warranted uncertainty, or, to use Bruner’s terminology, ’ problem— finding skills. 
Modeling and concept training were effective enough to warrant their further use 
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TABLE 4 






I 



Types of Correct and Incorrect Responses Made by Subjects in Conditions 
I, II, and III on the First Posttest 



o 

^ERiC 




Condition 


Response 
Category 
Used by 
Subject 


T 


Correct Responses 
F Don ’ t Know 


Number of 
Responses 
by Category 


Number of 
Errors by 
Category 


Number of 
Correct by 
Category 








1 


2 


3 


4 


5 


Used 


Used 


Responses 




DK 5 


0 


0 


0 


0 


0 


V 




18 


2 


16 


II 


DK 4 


1 


0 


0 


0 


3/ 




/ 


18 


5 


13 


Concept 

Training 

(N=8) 


DK 3 


0 


1 


1 


5/ 


/ 

ly 




4 


27 


13 


14 


DK 2 


0 


1 


¥ 


/ 

1/ 


/ 

2 


3 


1 


32 


15 


17 




DK 1 


0 


0/ 


{y 




1 


0 


1 


15 


3 


12 




False 


0 / 


^22/ 


< 


1 


2 


3 


1 


29 


7 


22 




True 


/(i. 




6 


0 


Q 


0 


0 


29 


6 


23 








1 




^ ITt 



i 
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Types of Correct and Incorrect Responses Made by Subjects in Conditions 
I, II, and III on the First Posttest 



Condition 


Response 
Category 
Used by 
Sub j ect 


Correct Responses 
T F Don’ t Know 

1 2 3 4 5 


Number of 
Responses 
by Category 
Used 


Number of 
Errors by 
Category 
Used 


Number of 
Correct by 
Category 
Responses 




DK 5 


0 


0 


1 


0 


0 


0/ 




8 


1 


7 




DK 4 


0 


0 


0 


1 


1/ 


/ 


Z 


14 


2 


12 


III 


DK 3 


0 


1 


0 


4/ 




z 


1 


23 


9 


14 


Modeling 

(N=7) 


DK 2 


0 


1 


5/ 




Z 


2 


1 


19 


9 


10 


DK 1 


0 


0/ 




7 


2 


0 


6 


25 


12 


13 




False 


1/ 


7 


7 


1 


3 


3 


4 


33 


14 


19 




True 


/20/ 




1 


0 


1 


1 ' 


2 


25 


5 


20 















147 



52 



95 



in the classroom. It would seem especially useful to develop for each 
curriculum area written tests that are similar in format to the written 
subtests used in this experiment. In some preliminary attempts to use 
such tests, teachers have found them stim.ulating to students. 

But the devising of such tests is difficulty it forces teachers to 
sharpen their awareness of problematic matters. Parenthetically, it is 
hoped that teachers who have developed skill in writing tests like the 
ones used here (hence in discriminating between nonproblematic and types 
of problematic situations) will more frequently discuss problematic matters 
in class. The teacher, then, rather than a "well- rehearsed" student, could 
serve as the initial model. He could express warranted uncertainty in class 
discussions and reinforce all students who did likewise. 
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But when such techniques as modeling and concept learning have been 
employed, and the expression of uncertainty becomes more frequent, what else 
happens? Do students learn more? Do habits of inquiry develop? How do 
teachers adapt to the new patterns of discussion? These complex and challeng- 
ing problems remain for teachers and educational researchers to explore. 
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APPENDIX A 

Sample Protocol of a Concept Learning Session 

(After introductions and informal remarks to gain rapport, the experimenter 

and a student sat down in a comfortable place by the playground and concept 

training began.) 

E: We want to teach you and the rest of your class how to tell the difference 

between types of questions you can answer correctly and types of questions 

to which you can’t be sure of the answer. There are a lot of things no 
one knows very much about. Also, some people know things others don’t know. 
Can you ask me a question which you can answer but I can’t? 

S: (After a brief pause) How old is my oldest brother? 

E: I don’t know. That was a good question. There are a lot of things some 

people know but others don’t. For example, how high is that flagpole? 

The man who built -it might be able to tell us. Who lives in the house 
across the street? 

S: I don’t know. 

E: Do you think anyone knows? 

S: Yes — the people who live there. 

E: Mm-hmm. Can you ask me another question someone could answer but I can’t? 

S: How many brothers do I have? 

E: Good. There are other kinds of questions to which no one knows the answer, 

but we could figure out a way to find the answer. For instance, how many 
words are there in today’s newspaper? Probably no one knows, but is there 
a way we could discover the correct answer for ourselves? 

St We could sit down and count them all if we were crazy enough. (Both laugh) 

Et Can you ask me a question no one can answer but for which we could find out 
the answer? 

S: How many stars are there in the sky? 

E: How would you find out the answer? 

S: I think you could find out because this morning we took a field trip to the 

astronomy department of a junior c-ollege, and the man there told the class 
there were as many stars in the sky as there are grains of sand on the earth 
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E: So you’d count all the grains of sand? 

S: I guess so. 

E; How did that man know that the number of stars equals the number of 
grains of sand? 

S; I don’t know. Maybe he just meant that there are a lot of stars. 

E: Maybe so. It would be a good idea to ask him. As far as I know, no 

one really has any idea how many stars there are because our telescopes 
aren’t good enough to see them all. But experts know there are a lot 
of them. Can you think of anything else no one knows, but that we could 
find out right now if we wanted to? 

S: How many hairs on my head? 

E: Good one ! Shall we start counting? (Both laugh) Now, there are some 

things no one knows and no one can even find out. I think you already 
asked a question like that — "How many stars are there?” Another ques- 
tion like that would be, "Is there life on Mars?” or "What is a sure 
cure for a head cold?” Can you think of any questions like these? 

S: Mmm (long pause). 

Ej Can you think of subjects you’ve learned in school that involve some 
things that man still doesn't understand very well? 

S: Oh, well, where does gravity come from? 

E: That’s good. Scientists have some ideas but they don’t know for sure 

what the answer is, do they? There are other kinds of questions that 
you can only answer for yourself but you cai>’t give a sure answer for 
other people. These are value judgments. You can tell how you feel about 
some things, but those feelings aren’t necessarily true for everyone else. 
For example, what is the best tasting food in the world? 

S: Ice cream. 

F: That’s ny favorite food too, especially chocolate ice cream. Ice cream 

is our "best tasting food” but can we say that ice cream is the best 
food in the world for everyone? 

S: No. 

E; The answer to that question is just a matter of the way you yourself feel, 
but other people may feel differently. Another question like that would be, 
"Is green the prettiest color?” Can you think of a question like this? 
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S: Who is the nicest person in the world? 

F: That's a good example. Now there is one other type of question we're 

going to talk about. It's one that no one can answer because it is 
about an event that hasn't happened yet. For example, when will the 
first man land on Saturn? 

S: I don't know, but probably pretty soon. 

E: For some questions about future events, we can often make some very 

good guesses about the answer, but "’e never can be completely cer- 
tain what the answer is. Can you think of one of these kinds of 
questions? 

S: Will I be living in California next year? 

E: That's good. Another question like this would be, "How tall will 

you be when you are grown up?" 
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APPENDIX B 

First Written Posttest 



Directions: Read the following statements. Then circle True, False, or 

Don’t Know, depending on whether you think the statement is true or false 
or you don't know. If you circle Don’t Know, also circle one of the num- 
bers that follow, to explain why you don’t know. The meanings of the numbers 
are: 



1. You don’t know but you could find out from some other person in the world. 

2. No one knows but someone could find out. 

3. No one knows how to find out the answer to this question. 

4. This is a value statement. It is just the way someone feels about some- 
thing. It is not true jor false. 

5. No one knows because it hasn’t happened yet. 

Examples : 

1. One plus one equal two. 

(This mathematical equation 
is always true.) 

2. There are 25 hours in one day. 

(This statement is false, because 
there are always 24 hours in one 
day.) 

3. The population qC Waterville, Ma. 
is 53,120. (You don^.t know, but 
someone who worlds in Waterville ’s 
City Hall probably does.) 

4. There were 200,500 words printed 
in last night’s paper. (Nobody 
bothered to count, but if you 
wanted to find out, you could al- 
ways count the words yourself.) 

5. Camels like rock-and-roll better 
than opera. (This could be true, 
but since we cannot ask camels, 
we cannot know for sure.) 
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True False Don’t Know 12345 



True False Don’t Know 12345 



True False Don’t Know 12345 



True False Don’t Know 12345 



True False Don’t Know 12345 
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6. 


Red is prectler than blue. 

(Though some people think so, others 
disagree. It is really a matter of 
opinion, neither true nor false.) 


True 


False 


Don't 


Know 


7. 


A man will land on Saturn in 1980. 
(Even if some people think that this 
is likely, we cannot know for sure 
since it hasn't happened yet.) 


True 


False 


Don' t 


Know 


1. 


Camels are used in hot, dry places. 


True 


False 


Don ' t 


Know 


2. 


All animals like hot climates. 


True 


False 


Don' t 


Know 


3. 


The basket over Mother Camel's 
nose is comfortable. 


True 


False 


Don' t 


Know 


4. 


All's turban is made of silk. 


True 


False 


Don' t 


Know 


5. 


Baby camel preferred to play 
with his little camel friend 
rather than with Ali. 


True 


False 


Don' t 


Know 


6. 


Ali has 63,474 hairs on his head. 


True 


False 


Don' t 


Know 


7. 


All's father is a very young man. 


True 


False 


Don't 


Know 


8. 


The camel is the ugliest of all 
animals. 


True 


False 


Don' t 


Know 


9. 


Ali will be a farmer when he 
grows up. 


True 


False 


Don' t 


Know 


10. 


There are 10,243 gallons of water 
in the pond in front of the village. 


True 


False 


Don' t 


Know 


11. 


Baby camel often has pleasant 
dreams. 


True 


False 


Don' t 


Know 


12. 


Camels make the ugliest noise 
of all animals. 


True 


False 


Don' t 


Know 


13. 


Ali has his own bedroom at home. 


True 


Fals J 


Don' t 


Know 


14. 


All camels in the market are 
healthy. 


True 


False 


Don' t 


Know 


15. 


Ali will always live in the desert. 


True 


False 


Don' t 


Know 


16. 


The desert is the best place in 


True 


False 


Don' t Know 



the world to live# 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 

1 2 3 4 5 
1 2 3 4 5 
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17. 


Food is stored in a camel's hump. 


True 


False 


Don' 


t 


Know 


1 


2 


3 


4 


18. 


The length of the average step 


True 


False 


Don' 


t 


Know 


1 


2 


3 


4 




baby camel takes is three feet. 




















19. 


Camels may be bought in camel 


True 


False 


Don' 


t 


Know 


1 


2 


3 


4 




markets. 




















20. 


Ali was afraid of sand storms 


True 


False 


Don' 


t 


Know 


1 


2 


3 


4 




when he was young. 




















21. 


Baby camel will never again 


True 


False 


Don' 


t 


Know 


1 


2 


3 


4 



get sick in a sand storm. 
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